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Abstract 

In two recent papers, Rudolph and Destexhe (Neural Comp. 15, 2577-2618, 2003; Neural Comp. in press, 2005) 
studied a leaky integrator model (i.e. an RC-circuit) driven by correlated ("colored") Gaussian conductance noise 
and Gaussian current noise. In the first paper they derived an expression for the stationary probability density of 
the membrane voltage; in the second paper this expression was modified to cover a larger parameter regime. Here 
we show by standard analysis of solvable limit cases (white-noise limit of additive and multiplicative noise sources; 
only slow multiplicative noise; only additive noise) and by numerical simulations that their first result does not hold 
for the general colored-noise case and uncover the errors made in the derivation of a Fokker-Planck equation for 
the probability density. Furthermore, we demonstrate analytically (including an exact integral expression for the 
time-dependent mean value of the voltage) and by comparison to simulation results, that the extended expression 
for the probability density works much better but still does not solve exactly the full colored- noise problem. We 
also show that at stronger synaptic input the stationary mean value of the linear voltage model may diverge and 
give an exact condition relating the system parameters for which this takes place. 



1 Introduction 



The inh erent randomness of neural sp i king has stimulated the exploration of stochastic neuron models for several 



decades I Holden . 



1974 iTuckweil Il98al HoSfll) . The subthreshold membrane voltage of cortical neurons shows strong 



fluctuations in vivo caused mainly by synaptic stimuli coming from as many as tens of thousands of presynaptic 
neurons. In the theoretical literature these stimuli have been approximated in different ways. The most biophysically 
realistic description is to model an extended neuron with different sorts of synapses distributed over the dendrite and 
possibly the soma, with each synapse following its own kinetics when excited by random incoming pulses that change 
the local conductance. In a "point-neuron" model for the membrane potential in the spike generating zone, this 
amounts to an effective conductance noise for each sort of synapse. If the contribution of a single spike is small and 
the effective input rates are high, the incoming spike trains can be w ell approximat ed by Gaussian white noise; this is 



known as the diffusion approximation of spike train input (see, e.g. 



Holder 



Furthermore, these conductance 



fluctuations driving th e membrane voltage dyn amics will be correlated in time (the noise will be "colored") due to 



the synaptic filtering l|Brunel and SergiL 119981) . Assuming the validity of the diffusion approximation, two further 



common approximations found in the theoretical literature are (1) to replace the conductance noise by a current 
noise; and (2) to neglect the correlation of the noise and to use a white noise. To explore the validity of these ap- 



proximations has been the aim of a number of recent theory p apers ({Rudolph and Destexhe 



Richardson and Gerstnei 



200 



i 



Rudolph and Destexhe 



tn eory p a 



200 



i 



Richardso: 



3 



2004; 



Rudolph and Destexhd l|2003() (in the following abbreviated by R&D) recently studied the subthreshold voltage dy- 
namics driven by colored Gaussian conductance and current noises, with the goal of deriving analytical expressions for 
the probability density of the voltage fluctuations in the absence of a spike-generating mechanism. Such expressions 
are desirable because they permit to use experimentally measured voltage traces in vivo to determine (or at least to 
obtain constraints on) synaptic parameters. R&D gave a one-dimensional Fokker-Planck equation for the evolution of 
the probability density of the voltage variable and solved this equation in the stationary state. Comparing this solution 
to results of numerical simulations they found a good agreement to simulations of the full model. In a recent Note, 
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however, they discovered a disagreement of their formula to simulations in extreme parameter regimes. R&D proposed 
an extended expression that is functionally equivalent to their original formula; it results from effective correlation 
times that were introduced into their original formula in a heuristic manner. According to R&D this new expression 
fits simulation results well for various parameter sets. 

In this comment we show that both proposed formulas are not exact solutions of the mathematical problem posed 
by R&D. We demonstrate this by the analysis of limit cases, by means of an exact analytical result for the mean 
value of the voltage as well as by numerical simulation results. The failure of the first formula is pronounced, e.g. it 
fails, for instance, dramatically if the synaptic correlation times are varied by only one order of magnitude relative to 
R&D's standard parameters. However, the extended expression, although not an exact solution of the problem, seems 
to provide a reasonable approximation for the probability density of the membrane voltage if the conductance noise 
is not too strong. We also show that if the conductance noise is strong, the model itself and not only the solutions 
proposed by R&D becomes problematic: the moments of the voltage, e.g. its stationary mean value, diverge. For the 
mean value we will give an exact solution and identify by means of this solution the parameters for which a divergence 
is observed. 

This paper is organized as follows. In the next section, we introduce the model which was studied by R&D. In the 
following sections we study the limit cases of only white noise (section|21l , of only additive colored noise (section^, and 
of slow ("static") multiphcative noise (section [SJl. In sectional we derive expressions for the time-dependent and for 
the stationary mean value of the voltage at arbitrary values of the correlation times. SecQis devoted to a comparison 
of numerical simulations to the various theoretical formulas. We summarize and discuss our findings in section |H1 In 
the appendix^ we uncover the errors in the derivation of the Fokker-Planck equation made by R&D. We anticipate 
that our results will help future investigations of the neural colored noise problem. 

2 Basic model 

The current balance equation for a patch of passive membrane is 



Crn^ = -9L{V{t)-EL)-llsyn{t) (1) 



where Cm is the specific membrane capacity, a is the membrane area, and gL and the leak conductance and reversal 
potential, respectively. The total synaptic current is given by 

Isyn = gemVit) - E,) + g^{t){V {t) - E,) - I{t) (2) 

with (7e,i being the noisy conductances for excitatory and inhibitory synapses and E^a the respective reversal potentials; 
I{t) is an additional noisy current. With respect to the conductances, R&D assume the diffusion approximation to be 
valid. This means to approximate the superposition of incoming presynaptic spikes at the excitatory and inhibitory 
synapses by Gaussian white noise. Including a first-order linear synaptic filter, the conductances are consequently 
described by Ornstein-Uhlenbeck processes (OUP); similarly, R&D also assume an Ornstein-Uhlenbeck process for the 
current I{t) 



^ = --i9eit)-9e0) + \r-^Ut), (3) 
at Te \ Te 




«fl . (4) 



Here the functions £,e,ij{t) are independent Gaussian white noise sources with {^k{t)£,i{t')) — Sk,iS{t — t') ( here 
k, I e {e, i, 1} and the brackets (• • •) stand for a stationary ensemble average). The processes ge, gi, and / are Gaussian 
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distributed around the mean values geO,gio, and Iq with variances a'^,af, and a'j, respectively 

1 



Pe{ge) 
Pl{I) 



1 



1 



:exp [-(g,- 3,0)2/(2^2)] 

cxp [-(g,-5,o)V(2'T2)] , 
exp [-(/-/o)2/(2a2)]. 



(6) 
(7) 
(8) 



As discussed by R&D, these solutions permit unphysical negative conductances which become especially important if 
(jeo/ce and gio/(Ti are small. 

Furthermore, the three processes are exponentially correlated with the correlation times given by Te,Ti, and t/, 
respectively 



((.9eW - geo){ge{t 4 

{m-io)ii{t 



t) - ffeo)) 

t) - gto)) 



lo)) 



al exp[-|T|/Te], 
0-f exp[-|T|/T,], 
(t| exp[-|r|/T/]. 



(9) 

(10) 

(11) 



Note that R&D used another parameter to quantify the strength of the noise processes, namely I?{e.i./} = 20-2 . ^/re^ij. 
Here we will not follow this unusual scaling^ but consider variations of the correlation times at either fixed variance 
0-2 . J of the OUPs or fixed noise intensities 0-2 - jTe^ij. 

Eq. Q can be looked upon as a one-dimensional dynamics driven by multiplicative and additive colored noises. 
Equivalently, it can be together with eq. ©, eq. Q), and eq. Q regarded as a four-dimensional nonlinear dynamical 
system driven by only additive white noise. For such a process it is in general quite difficult to calculate the statistics, 
such as the stationary probability density Pq{V^ g^, gi, I) or the stationary marginal densi ty for the driv en variable 
p{V) — J J f dgedgidIPo{V, ge, gi, I) unless so-called potential conditions are met (see, e.g. ( Riskeni 1984 )). It can be 
easily shown that the above problem does not fulfill these potential conditions, and no solution has yet been found. 
R&D have proposed a solution for the stationary marginal density of the membrane voltage p{V) for colored noises of 
arbitrary correlation times driving their system. Their solution for the stationary probability of the membrane voltage 
reads 



PRoiV) = TV exp 



ai 



262 

2&2ao - aibi 



\n{b2V^ + biV + bo)+ 



arctan 



with N being the normalization constant and with the abbreviations 

1 



ao = 



ai 



(a„a)2 

1 



(Cmfl)' 



{2C,na{gLELa + geoEe + gioEi 
:{2Crna{gLa + geo + gm) + crl' 



2b2V + bi 
loCma + alreEe + afnEi), 



(12) 



bo 
bi 
b2 



1 



(C„a)2 
2 



{ajreEe 



cr?T/), 



(C™a)2 

(0-2 + a-ln). 



ofnE,), 



(13) 



^In general, two different intensity scalings for an OUP rj^t) are used in the literature (see, e.g. iHanggi and Jun3 . ll995h 

1. fixing the noise intensity Q = dT{r){t)r]{t + T)) = a'^T, allowing for a proper white-noise limit by letting r approach zero; with 
fixed noise intensity and t — » 00 (static limit), the effect of the OUP vanishes, since the variance of the process tends to zero 

2. fixing the noise variance which leads to a finite effect of the noise for r ^ 00 (static limit) but makes the noise effect vanish as 
r -* 

R&D use functions C({e,i,i}{t)} the long-time limit of which is proportional to the noise intensity ct^ ^ jT^^ij- 
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In a subsequent Note on their paper Rudolph and Destexhel l|2005|) . R&D considered the case of only multiplicative 
colored noise (tj/ = 0) and showed that the solution eq. H12|) does not fit numerical simulations for certain parameter 
regimes. They claim that this disagreement is due to a filtering problem not properly taken into account in their 
previous work. They proposed a new solution for the case of only multiplicative noise that is functionally equivalent 
to eq. H12() for aj = but simply replaces correlation times by effective correlation times 



Te + To 

where tq — aCm/ {o-dL + 5e0 + 9io)- Explicitely, this extended expression is given by 



(14) 



PRD.ext{V) = iV'exp 



^1 111 (j^^iV - ^e)' + J^^iV - E,f ) + 



A2 arctan 



' alrlXV - E,) + aU{V ~ E,) 
^ {E,~E,)^alT',aiT[ 



(15) 



with the abbreviations 



gLa{aX{EL ~ E,) + ^^/(Sl - E,)) + (.9,0^^/ - g.^alr'^iE, - E,) 



^1 0.^2^, ^„2^n (16) 



[E, - i?.)v/^F^(a2T^ + afT;)/(2a„a) 



(17) 



The introduction of the effec tive correlat i on tim es was justified by considering the effective-time constant (ETC) or 
Gaussian approximation from Richards'onI ( 2004 ) (see below) which reduces the system to one with additive noise. The 
new f ormula eq. H15f) fits well their simulation results for various combinations of parameters l|Rudolph and Destexhe , 
200J. 



In this comment, we will show that neither of these formulas yields the exact solution of the mathematical problem. 
As we will show first, the original formula fails significantly outside the limited parameter range investigated in R&D 
2003 . Apparently, the second formula provides a good fit formula for a number of parameter sets. It also reproduces 
two of the simple limit cases, in which the first formula fails. By means of the third limit case as well as of an exact 
solution for the stationary mean value (derived in section IHl we can, however, show that the new formula is not an 
exact result either. 

To demonstrate the invalidity of the first expression in the general case, we will show that eq. (|12|) fails in three limits 
that are tractable by standard techniques: (1) the white noise limit of all three colored noise sources, i.e. keeping the 
noise intensities ^ iTe,i,i fixed and letting all noise correlation times tend to zero Te^i 0; (2) the case of additive 
colored noise only; (3) the limit of large Te^i in the case of multiplicative colored noises with fixed variances Cg and 
af. In all cases, we also ask whether mean and variance can be expected to be finite as it has been tacitly assumed 
by R&D. 

We will also compare both solutions proposed by R&D as well as our own analytical results for the limit cases to 
numerical simulation results. While the failure of the first formula eq. (|12() is pronounced except for a small parameter 
regime, deviations of the extended expression eq. (|15|l are much smaller and for six different parameter sets inspected, 
the new formula can be at least regarded as a good approximation. Parameters can be found, however, where deviations 
of this new formula from numerical simulations become more serious. 
To simplify the notation we will use the new variable v — V — A with 



^ _ 9LaEL + gepEe + gipEj + Iq ^^^^ 
gLa + geo + 9i0 



Then the equations can be recast into 



(3v-y,{v-Ve)-y^iv-V,)+yi (19) 

(20) 
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with the abbreviations 

^ ^ ffLQ + ffeo + g»o ^21) 

aCra 

= ^^e,»-A, (22) 

^e,i,I = (^eA,I /{aCm)- (23) 

Once we have found an expression for the probabihty density of v, the density for the original variable V is given by 
the former density taken at w = (V^ — A). 

Finally, we briefly explain the effective-time constant (ETC) or Gaussian approximation (cf. RichardsonI 1 2004 k 



Richardson and Gerstnen (|2i](}3) references therein) which we will refer to later on. Assuming weak noise sources, 
the voltage will fluctuate around the deterministic equilibrium value u = with an amplitude proportional to the 
square root of the sum of the noise variances, e.g. for only excitatory conductance fluctuations we would have a 
proportionality to the standard deviation of y^, i.e. cx {vD ■ From this we can see that the multiplicative 

terms yeV and yjV make a contribution proportional to the squares of the standard deviations and can therefore be 
neglected for weak noise. The resulting dynamics contains only additive noise sources 

v = -l3v + y^V^ + yiV,+yi. (24) 

The stationary probability density is a Gaussian 

eM-vV{'^{v^)ETc)] 
PETc{v) = , , „, (25) 



with zero mean and a variance given by IjRichardso: 

^^^^ - TTWe + TT^ + TT^ (2^) 

The solution takes into account the effect of the mean conductances on the effective membrane time constant 1//3 
through eq. l(?T)) . 

3 The white-noise Umit 

If we fix the noise intensities 

Qe,iJ = d'e^ijTe^ij, (27) 

we may consider t he limit of white noise by letting r^^ij — > 0. A special case of this has been recently considered by 
Richards'onI 1 2004 ) with ct/ = (only multiplicative noise is present). 



In the white- noise limit, the three OUPs approach mutually independent white- noise sources 

ye y/We^eit), y^ ^ y/2Ql^^{t), yi ^ y/WiS^iit) (28) 
and, thus the current balance equation eq. H19|l becomes 



v = -Pv- y/W.(v - Ve)Ut) ~ V2Qi{v - V,)^,{t) + VWi^iit) (29) 
which is equivalent^ to a driving by a single Gaussian noise ^{t) 



V 



-I3v + V2Qe(w - VeY + 2Q,(t; - V^Y + 2Qii{t) (30) 



^The sum of three independent Gaussian noise sources gives one Gaussian noise the variance of which equals the sum of the variances 
of the single noise sources. 
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with {^{t)^{t')) — S{t~t'). Since we approach the white noise Umit with havin g in mind colored noises with n eKligible 



correlation times, eq. H3l)|l has to be interpreted in the sense of Stratonovich I Riskeni 
6.5). The drift and diffusion coefficients then read I Riskeni . 1984 . cf. (3.95) therein) 



1984; 



Gardiner 



19851 see sec. 



1 r7D(2) 

D^'^ = -Pv + Q,iv~Ve) + Q;iv^Vi) = -f3v + -- 



2 dv 



D^^^ = Qj + Q^{v-Ve)^ + Q,{v-Vi)^ 
and the stationary solution of the probability density is given by ( Riskeni 



1984L cf. eq. (5.13) therein) 



Pwn{v) 



V 

-ln(i?(2)) + J 



dx 



D(2)(:r) 



(31) 
(32) 



(33) 



where the subscript "wn" refers to white noise. 

After carrying out the integral, the solution can be written as follows 



Pwn{v) = iVexp 



J3 + b2 
2b2 



ln(b2V^ +biv + bo)+ 



: arctan 



2b2V + hi 
Uboh^bl 



with the abbreviations 



bo = Qi + QeV! + Q^V^ 

h - -2iQeVe+Q^V^) 
b2 = Qe + Qi 



(34) 



(35) 
(36) 
(37) 



Different versions of the wh i te-noise case have been discussed and also analytically studied in the Hterature (see, e.g.. 



Hanson and Tuckwell 



l ll983l 



Lanskv and Lanska , 



1987 



Lanska et al 



1994; Richardsoni 2004). In particular, eq. 



is consis tent with the expr ession for the voltage density in a leaky integrate-and-fire neuron driven by white noise'^ 
given by Richardsoni ( 2004 1. 

Since eq. H12(l was proposed by R&D as the solution for the probability density at arbitrary correlation times of the 
colored-noise sources, it should be also valid in the white- noise limit and agree with eq. (|34|l . On closer inspection it 
becomes apparent that both eq. H12|l and eq. (|15|) have the structure of the white- noise solution eq. (|34|l . Comparing 
the factors of the terms in the exponential, we find that the first solution (in terms of the shifted voltage variable and 
using the noise intensities eq. (|27|l ') can be written as follows 



PRDiv,Qe,Qi,Ql) = Pwn{v,Qe/2,Q^/2,Qi/2), 



(38) 



where the additional arguments of the functions indicate the parametric dependence of the densities on the noise 
intensities. According to eq. H38|) . if formulated in terms of the noise intensities (and not the noise variances) the 
first formula proposed by R&D does not depend on the correlation times r^^ij at all. Furthermore, it is evident from 
eq. 123) that the expression is incorrect in the white noise limit. If all correlation times r^^ij simultaneously go to 
zero, the density approaches the white-noise solution with only half of the true values of the noise intensities. The 
density will certainly depend on the noise intensities and will change if one uses only half of their values. 
We may also rewrite R&D's extended expression eq. ()15|l in terms of the white-noise density 



PRD,extiv,QejQi) = pwn{v,Qe/{^ + /^Tg), (5^/(1 + Pn) , Q I = 0) 



(39) 



^The density eq. I34i results from eq. (18) in lRichardsonI l2004) when firing and reset in the integrate-and-fire neuron become negligible. 
This can be formally achieved by letting threshold and reset voltage go to positive infinity. 
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This solution agrees with the original solution by R&D only for the specific parameter set 

Te = n = (40) 

We note that since the extended solution can be expressed by means of the white-noise density it makes sense to 
describe the extended expression by means of effective noise intensities 

- Y%t- (41) 

rather than in terms of the effective correlation times ^ (cf. eq. (|14() 'l used by R&D. The assertion behind eq. (|39|l 
is the following: the probability density of the membrane voltage is always equivalent to the white-noise density; 
correlations in the synaptic input (i.e. finite values of Te^ij) just lead to rescaled (smaller) noise intensities Q'^, j given 
in eq. (HI}. 

If we consider the white-noise limit of the r.h.s. of eq. H39() . we find that the extended expression eq. I|15|l reproduces 
this limit, i.e. 

lim PRD,ext{V,Qe,Qi) ^ Pwn{V,,Qe,Qi,Ql =0)- (42) 

So there is no problem with the extended expression in the white-noise limit. 



3.1 Divergence of moments in the white-noise hmit and in R&D's expressions for the 
probabihty density 

We consider the density eq. (|34|) in the limits v ±00 and conclude whether the moments and, in particular, the 
mean value of the white-noise density are finite; similar arguments will be applied to the solutions proposed by R&D. 
At large v and to leading order in l/w we obtain 



Pn,n{v) - \v\ b, Nb^ 2b. 



4M2-^P 



as V ^ ±00. (43) 



When calculating the nth moment, we have to multiply with and obtain a non-diverging integral only if v^pu,n{v) 
decays faster than v^^ . This is the case only \i n — {(3 + 62)/&2 < —1 or using eq. H37(l 

|(f")„„| < 00 iff /? > n(Q, + Qi) (44) 

where "iff" stands for "if and only if" and the index "wn" indicates that we consider the white-noise case. Note that 
no symmetry argument applies for odd n since the asymptotic limits differ for 00 and —00 according to eq. H43I) . For 
the mean, this implies that 

< 00 iff /3 > Qe + Qi (45) 

otherwise the integral diverges. 

In general, the power law tail in the density is a hint that (for white noise at least) we face the problem of rare strong 
deviations in the voltage, that are due to the specific properties of the model (multiplicative Gaussian noise). 
Because of eq. (|38(l similar conditions (differing by a prefactor of 1/2 on the respective right hand sides) also apply 
for the finiteness of the mean and variance of the original solution eq. (|12|l proposed by R&D. For the mean value of 
this solution one obtains the condition 

\{v)Rn\<oo iff /3>^1±^, (46) 

which should hold true in the general colored noise case but does not agree with the condition in eq. H45() even in the 
white-noise case. 

From the extended expression we obtain 

\{v)rdM < (x. iff /3 > + (47) 
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Note that eq. (|47|l agrees with eq. (|45|l only in the white-noise case (i.e. for Te,Ti — > 0). Below we will show that 
eq. ()45|l gives the correct condition for a finite mean value in the general case of arbitrary correlation times, too. Since 
for finite Te,Ti, the two conditions eq. (|45|) and eq. (|47|l differ, we can already conclude that the eq. (|15|l that led to 
condition eq. (|47|l cannot be the exact solution of the original problem. 



4 Additive colored noise 



Setting the multiplicative colored noise sources to zero, R&D obtain an expression for the marginal density in case of 
additive colored noise only (cf. eq. (3.7-3.9) in R&D) 

a^gLCrniV -EL-Io/igLa))^' 



Padd,RD{V) = iVexp 
which corresponds in our notation and in terms of the shifted variable v to 

Padd,RD{v) = iVexp 



' Qi 



(48) 



(49) 



Evidently, once more a factor 2 is missing already in the white- noise case (where the process v{t) itself becomes an 
Ornstein-Uhlenbeck process), since for an OUP we should have p ~ exp[— /3w^/(2Q/)]. However, there is also a missing 
additional dependence on the correlation time. 

For additive noise only, the original problem given in eq. JQ) reduces to 



V = -pv + yi, (50) 
yj = _ly, + ^^,(t). (51) 

Tl Tl 

This system is mathematically similar to the Gaussian approximation or effective-time constant approximation eq. (|25ll 
in which also no multiplicative noise is present. The density function for the voltage is well known; for the sake of 
clarity we show here how to calculate it. 

The system eqs. (|5UI51|I obeys the two-dimensional Fokker-Planck equation 

'yi , Qi 



dtP{v,yi,t) 



dy{Pv - yi) + dy 



^2 ^yi 



P{v,yi,t) 



(52) 



The stationary problem {dtPvi{v, yi) = 0) is solved by an ansatz P(){v, y) ^ exp[Aw^ + Bvy + Cy'^] yielding the solution 
for the full probability density 



Po(w, yi) = iVexp [yj - 2(3vyi 
Integrating over yj, yields the correct marginal density 

Padd{v) = 



if} 



ilH 2 
-CV 



/?(l + /3r/) 



2ttQi 



exp 



(53) 



(54) 



which is in disagreement with eq. H49I) and hence also with eq. I|48|) . From the correct solution given in eq. (|54|l . we 
also see what happens in the limit of infinite r for fixed noise intensity Qi : the exponent tends to minus infinity except 
at w = or, put differently, the variance of the distribution tends to zero and we end up with a 5 function at w = 0. 
This limit makes sense (cf. footnote^ but is not reflected at all in the original solution eq. (|15|l given by R&D. 
We can also rewrite the solution in terms of the white-noise solution in the case of vanishing multiplicative noise 



Paddiv) = Pwn{v, Qe = 0, Qi = 0, Ql/[l + Ptj]). 



(55) 



Thus, for the additive noise is true, what has been assumed by R&D in the case of multiplicative noise: the density 
in the general colored- noise case is given by the white-noise density with a rescaled noise intensity Q'j = Qi/[1 + /3t/] 
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(or equivalently, rescaled correlation time r} — 2ti /[\ + /3t/] in eq. H49|l with Qi — (J^t[). 

We cannot perform the hmit of only additive noise in the extended expression eq. (|15|l proposed by R&D because this 
solution was meant for the case of only multiplicative noise. If, however, we generalize the solution eq. H15|l to the case 
of additive and multiplicative colored noises, we can consider the limit of only additive noise in this solution. This is 
done by taking the original solution by R&D eq. H12I) and replacing not only the correlation times of the multiplicative 
noises Te^i by the effective ones ^ but also that of the additive noise t/ by an effective correlation time 

If we now take the limit Qg = Qi = 0, we obtain the correct density 

Prud.exf.add{v) = Pwn{v, Qe = 0, = 0, Ql/[l + /3r/]) (57) 



as becomes evident on comparing the r.h. sides of eq. (|57|l and cq. (|55|l . 

Finally, we note that the case of additive noise is the only limit that does not pose any condition on the finitencss of 
the moments. 

5 Static multiplicative noises only (limit of large Te ^) 

Here we assume for simplicity aj = and consider multiplicative noise with fixed variances ct^ ^ only. If the noise 
sources are much slower than the internal time scale of the system, i.e. if l/(/3re) and \/{(3Ti) are practically zero, we 
can neglect the time derivative in eq. H19(l . This means that the voltage adapts instantaneously to the multiplicative 
("static") noise sources which is strictly justified only for Pre, (in ^ oo. li Te,Ti attain large but finite values 
{f3Ti,/3Ti 3> 1), the formula derived below will be an approximation that works the better the larger these values are. 
Because of the slowness of the noise sources compared to the internal time scale, we call the resulting expression the 
" static- noise" theory for simplicity. This does not imply that the total system (membrane voltage plus noise sources) 
is not in the stationary state: we assume that any initial condition of the variables has decayed on a time scale t much 
larger** than Te^i- For a simulation of the density this has the practical implication that we should choose a simulation 
time much larger than any of the involved correlation times. 

Setting the time derivative in eq. (|19|l to zero, we can determine at which position the voltage variable will be for a 
given quasi-static pair of (ye,2/i) values, yielding 



VeVE + UiVi 

^ = 

P+Ve+Vi 

This sharp position will correspond to a, S peak of the probability density 



(58) 



VeVE + y^V, \ _ \y,iV, - K) - / ^ Pv + y,{v-V,y ^^^^ 



(here we have used 5{ax) — 5{x)/\a\). This peak has to be averaged over all possible values of the noise, i.e. integrated 
over the two Gaussian distributions in order to obtain the marginal density 

PstaUc{v) = {S{v~v{t))) 



OC OO 



[ye~\ 7 TTT X 



27rCTi(Te {v - VeY \ - Ve) 



exp 



yl yf 



(60) 



In the strict limit of f3Tg,/3Ti — » oo this would imply that t goes stronger to infinity than the correlation times r^^i do. 
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Carrying out these integrals yields 



PstaticW) 



^e^i\Ve - Vi\ 

7r/3^/x(u) 




where erf(z) is the error function (|Abraniowitz and Stegunlll97nt> and the functions ^{v) and iy{v) are given by 

aUv-V,f + af{v-V,r 



ix{v) 
v{v) 



/32 



(61) 

(62) 
(63) 



If one of the expressions by R&D eq. (|12|l or eq. p5|) would be the correct solution, it should converge for ct/ = and 
Te_i — > oo to the formula for the static case eq. (|61|l . In general, this is not the case since the functional structure of 
the white-noise solution and that of the static-noise solution are quite different. There is, however, one limit case in 
which the extended expression yields the same (although trivial) function. If we fix the noise intensities Qe,i and let 
the correlation times go to infinity, the variances will go to zero and the static-noise density eq. (|61|l approaches a 5 
peak &t V = 0. Although the extended expression eq. H15|l has a different functional dependence on system parameters 
and voltage, the same thing happens in the extended formula for r^^i — > oo because the effective noise intensities 
Q'e i ~ Qe,i/{^ + Ptcs) approach zero in this limit. The white-noise solution at vanishing noise intensities is, however, 
also a 5 peak at w = 0. Hence, in the limit of large correlation time at fixed noise intensities, both the static-noise 
theory eq. 1^61]) and the extended expression yield both the probability density of a noise-free system and therefore agree. 
For fixed variance where a non-trivial large-r limit of the probability density exists, the static- noise theory and the 
extended expression by R&D differ as we will also numerically verify later on. 

A final remark concerns the asymptotic behavior of the static-noise solution eq. 1)61(1 . The asymptotic expansions for 
V — > ±oo show that the density goes like in either limits. Hence, in this case we cannot obtain a finite variance of 
the membrane voltage at all (the integral J dv pstatic{v) will diverge). The mean may be finite since the coefficients 
of the term are symmetric in v. The estimation in the following section, however, will demonstrate that this is 
valid only strictly in the limit t^a — > oo but not at any large but finite value of t^s. So the mean may diverge for large 
but finite r^^i. 

6 Mean value of the voltage for arbitrary values of the correlation times 

By inspection of the limit cases we have already seen that the moments do not have to be finite for an apparently 
sensible choice of parameters. For the white-noise case it was shown that the mean of the voltage is finite only if 

/3 > Qe + Q^■ 

Next, we show by direct analytical solution of the stochastic differential equation eq. H19|) involving the colored noise 
sources eq. ((2()|l that this condition (i.e. eq. ((45|l ) holds in general and thus a divergence of the mean is obtained for 

/? < Qe+Qi- 

For only one realization of the process eq. ((T^ . the driving functions ye{t), yi{t), and yi{t) can be rega rded as just 
time-d ependent parameters in a linear differential equation. The solution is then straightforward (see also 
12004!) for the special case of only multiplicative noise) 



Richardson 



v(t) 



vo exp 



Pt- du{ye{u) -I- yi{u)) 



ds{V,y,[s) + V^y,{s) + yi{s))e-l'^'-'^ 



exp 



du{ye{u) + yi{u)) 



(64) 
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t 

The integrated noise processes We.i{s,t) — J duyej{u) in the exponents are independent Gaussian processes with 

s 

variance 



t)) = 2Q,,,(t -5-re,, + r,,,e'^'-^)/"-')- (65) 
For a Gaussian variable we know that (e"') = e^'"'^/^ jGardineii Il985|) . Using this relation for the integrated noise 



i 

processes together with eq. (|65|l and expressing the average (?/e,i(s) exp[— J duye,i(u)]) by a derivative of the exponential 

with respect to s, we find an integral expression for the mean value 

{v{t)) = «oe('3=+Q-«*exp[-re/e(t)-r,/,(0] 



i 



ds{V,f,{s) + ^J,(s)}eW=+Q'-«--=/=(^)--'^(-) (66) 







where fe,i{s) = Qe,z(l — exp[— s/re_i]). The stationary mean value corresponding to the stationary density is obtained 
from this expression in the asymptotic limit t ^ oo. We want to draw the reader's attention to the fact that this 
mean value is finite exactly for the same condition as for the white noise case, i.e. for 

\{v)\ < oo iS |3>Qe + Q^ (67) 

Firstly, this is so because otherwise the exponent {Qe + Qi — P)t in the first line is positive and the exponential diverges 

for t — > oo. Furthermore, if /3 < Qe + Qi the exponential in the integrand diverges at large s. 

In terms of the original parameters of R&D the condition for a finite stationary mean value of the voltage reads 

I (z;) I < oo iff g^a + 5eo + .9.0 > '"'""^J; (68) 

Note t hat this depends also on a and Cm, and not only on the synaptic parameters. R&D use as standard parameter 
values ^Rudolph and Destexhj. booi p. 2589) geo = 0.0121 /iS, gio = 0.0573 ^S, de = 0.012 /iS, ai = 0.0264 /itS, 



Te = 2.728 ms, n = 10.49 ms, a = 34636/im^, and Cm = 1/iF/cm^. They state that the parameters have been varied 
in numerical simulation s from 0% to 260% relative to these standard values covering more than "the physiological 
range observed in vivo" ( Rudolph and Destexhg , 200^ . Inserting the standard values into the relation eq. (|68|l yields 



0.085lAfS > 0.0221^S. (69) 

So in this case the mean will be finite. However, using twice of the standard value for the inhibitory noise standard 
deviation, i.e. ai = 0.0528 fiS (corresponding to 200% of the standard value) and all other parameters as before, 
leads already to a diverging mean because we obtain 0.0852/iS on the right hand side of eq. (|68() while the left hand 
side is unchanged. This means, even in the parameter regime that R&D studied, the model predicts an infinite mean 
value of the voltage. A stronger violation of eq. will be observed by either increasing the standard deviations CTe.i 
and/or correlation times t^j or by decreasing the mean conductances ge^i- We also note that for higher moments, and 
especially for the variance, the condition for finiteness will be even more restrictive as can be concluded from the limit 
cases investigated before. 

The stationary mean value at arbitrary correlation times can be inferred from eq. (|66|l by taking the limit t — > oo. 
Assuming the relation eq. (|67|) holds true, we can neglect the first term involving the initial condition vq and obtain 

oo 

f ds{Vefeis) + V,f^is)}eMiQe + Q^-P)s-TJeis)-TJ,is)] (70) 



We can also use eq. (|70|) to recover the white-noise result for the mean as for instance found in Richards'onl ( 2004 ) by 
taking Te^i — > 0. In this case we can integrate eq. H70|l and obtain 

oo 

{v)n,n = -{VeQe + ViQi} J ds exp[(Qe + " f3)s] 



_VeQe + V^ , . 

P-Qe-Q^ ^ ' 
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Because of the similarity of the R&D solution to the white- noise solution (cf. eq. H38|l '). we can also infer that the 
mean value of the former density is 

, , VeQe + V^Q^ 

Note the different prefactor of /? in the denominator that is due to the factor 1/2 in noise intensities of the solution 
eq. by R&D. 

Final ly, we can also determine easily the mean value for the extended solution by R&D IjRudolph and Destexhe , 
bnOfil) since also this solution is equivalent to the white- noise solution with rescaled noise intensities. Using the noise 
intensities Q'^ ^ from eq. (|4HI we obtain 

VMre) + V,Q[{n) 

\V)RD,ext — 



(73) 



/3(1 + fin){l + Pre) - Qeil + Pn) - Q^{l + Pre) 

We will verify numerically that this expression is not equal to the exact solution eq. (|7U|I . One can, however, show that 
for small to medium values of the correlation times r^^i and weak noise intensities these differences are not drastic. 
If we expand both eq. Ht)t)|) and eq. (|73|l for small noise intensities Qe, Qi (assuming for the former that the products 
QeTcQiTi are small, too), the resulting expressions a gree to first order and als o agre e with a recently derived weak 



noise result for filtered Poissonian shot noise given bv iRichardson and Gerstner J2OO5I cf. eq.(D.3)) 



M-- VeQeil+PT^)+V^Q^i^+pT,) , , 

The higher order terms differ and that is why a discrepancy between both expressions can be seen at non-weak noise. 
The results for the mean value achieved in this section are useful in two respects. Firstly, we can check whether 
trajectories indeed diverge for parameters where the relation eq. ()67fl is violated. Secondly, the exact solution for 
the stationary mean value and the simple expressions resulting for the different solutions proposed by R&D can be 
compared in order to reveal their range of validity. This is done in the next section. 



7 Comparison to simulations 

Here we compare the different formulas for the probability density of the membrane voltage and its mean value to 
numerical simulations for different values of the correlation times, restricting ourselves to the case of multiplicative 
noise only. We will first discuss the original expression eq. (|12|l proposed by R&D and the analytical solutions for the 
limit cases of white and static multiplicative noise (eq. (|34(l and eq. H61(l . respectively); later we examine the validity 
of the new extended expression. Finally, we will also check the stationary and time-dependent mean value of the 
membrane voltage and discuss how well these simple statistical characteristics are reproduced by the different theories 
including our exact result eq. Ht)t)|l . 

To check the validity of the different expressions we will use first a dimensionless parameter set where P — I but also 
the original parameter set used by R&D (2003). In both cases we consider variations of the correlation times between 
three orders of magnitude (i.e. standard values are varied between 10% and 1000%). Note that the latter choice goes 
beyond the range originally considered by R&D (2003) where parameter variations were limited to the range 0%-260%. 

7.1 Probability density of the membrane voltage - original expression by R&D 

In a first set of simulations we ignore the physical dimensions of all the parameters and pick rather arbitrary but simple 
values {P — l,Qi = 0.75, Qe = 0.075). Keeping the ratio of the correlation times (t/ = 5Te) and the values of the noise 
intensities Qe,Qi fixed, we vary the correlation times. In Fig. ^ simulation results are shown for Te = 10^^, 10^^,1, 
and 10. We recall that with a fixed noise intensity according to the result by R&D given in eq. (|12|) . the probability 
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V in a.u. V in a.u. 

Figure 1: Theoretical expressions for the probability density of the shifted membrane voltage v — V ~ A compared to results 
of numerical simulations in case of pure multiplicative noises. Panel a: The density according to eq. (1121 (theory by R&D) 
is compared to simulations at different correlation times (r^ as indicated, Ti = 5re). Since the noise intensities are fixed 
(Qe ~ 0.075, Qi — 0.75), the simulated densities at different correlation times should fall all onto the solid line according to 
eq. (1121 which is not the case. Panel b: The simulations at small (re = 0.01) and large (re — 10) correlation times are compared 
to our expressions found in the limit case of white and static noise, i.e. eq. 1341 and eq. 1611 . respectively. Note that, in the 
constant-intensity scaling, eq. (1611 depends implicitly on re,i since the variances change as tJe,,; = Qe,i/re,i. In both panels 
/3 = 1 and Qi = 0. For the simulations here and in the following figures, we followed a single realization v{t) using a simple 
Euler procedure. We used a time step of At = 0.001 and a simulation time of 10* time steps. The probability density at a 
certain voltage is then proportional to the time spent by the realization in a small region around this voltage. Decreasing At 
or increasing the simulation time did not change the above results. 



should not depend on Tg at all. 



It is obvious, however, in Fig.^ that the simulation data depend strongly on the correlation times in contrast to what 
is predicted by eq. (|12|) . The difference between the original theory by R&D and the simulations is smallest for an 
intermediate correlation time (rg = 1). In contrast to the general discrepancy between simulations and eq. (|12|l . the 
white-noise formula eq. (|34|l and the formula from the static-noise theory (cf. solid and dotted lines in Fig. ^p) agree 
well with the simulations at Tg — 0.01 (circles) and Tg — 10 (diamonds), respectively. The small differences between 
simulations and theory decrease as we go to smaller or larger correlation times, re spectively, as expected. 
R&D also present results of numerical simulations ( Rudolph and Destexhg . 2003|) . These simulations seem to agree 



fairly well with their form ula. In order to give a flavor o f the reliability of these data we have repeated the simulations 
for one parameter set in iRudolph and Destexhd booal Fig. 2b). These data are shown in Fig. \Bp and compared to 
the original solution eq. (|12|) by R&D. 

For this specific parameter set the agreement is indeed relatively good, although there are differences between the 
formula and the simulation results in the location of the maximum as well as at the flanks of the density. These 
differences do not vanish by extending the simulation time or decreasing the time step; hence, the curve according to 
eq. (|12|l does not seem to be an exact solution but at best a good approximation. 

The disagreement becomes significant if the correlation times are changed by one order of magnitude (Fig. and c) 
(in this case we keep the variances of the noises constant, as R&D have done rather than the noise intensities as in 
Fig. The asymptotic formulas for either vanishing (Fig. [2^) or infinite (Fig.|2t) correlation times derived here in 
this paper do a much better job in these limits. Note that the large correlation time used in Fig. |2t are outside the 
range considered by R&D (2003). Regardless of the fact that the correlation times we have used in Fig. |2K and c are 
possibly outside the physiological range, an analytical solution should also cover these cases. Regarding the question 
of whether the correlation time is short (close to the white-noise limit), l ong (close to the static l i mit), or intermediate 
(as it seems to be the case in the original parameter set of Fig. 2b in I Rudolph and Destexhe . 2003)), it is not the 
absolute value of Te^ij that matters but the product fiTe^ij- Varying one or more of the parameters QLi Qeo, 910,0-, or 
Cm can push the dynamics in one of the limit cases without the necessity of changing Tsaj- 
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V in Volt 

Figure 2: Probability density of membrane voltage for different orders of magnitude of the correlation times Te,Ti. Panel (b) 
corresponds to the parameter set used by R&D in Fig. 2b of their paper. Starting from this case, we show simulation results with 
both time constants reduced (panel a) or enlarged (panel c) by one order of magnitude. We compare the simulations in all cases 
to the curve according to the expression given by R&D (here eq. il'Il ) (dashed lines) and in the limit cases of short and large 
correlation times to the white noise (eq. 13411 ) and the static noise (eq. mil ) theories (both solid lines), respectively. Note that 
the expressions for the limit cases fit the simulation data not perfectly but much better than the original solution eq. by 
R&D. Parameters: ql = 0.0452mS/cm^, a = 34636/im^ Cm = lfiF/cm^,EL = -80mV,Ee = OmV,^;^ = -75mV,cre = 0.012/iS, 
(Ti = 0.0264/.IS, Qeo = 0.0121/iS, gto = 0.0573/iS; additive-noise parameters {ai,Io) are all zero, correlation times of the n oises 
as indicated. Here we used a time step of At — 0.1 ms and a simulation time of 100s as in llRudolph and Destexhd |2003^ . 

7.2 Probability density of the membrane voltage - extended expression by R&D 

So far we have not considered the extended expression (R&D, 2005) with the effective correlation times. Plotting the 
simulation data shown in Fig. ^ and Fig. |21 against this new formula, gives indeed a very good although not perfect 
agreement (cf. Fig. |2K and b). Note, for instance, in Fig. |2K that the height of the peak for Te = 1 and the location 
of the maximum for Tg = 0.1 is slightly underestimated by the new theory. Since most of the data look similar to 
Gaussians, we may also check whether they are described by the ETC theory (cf. eq. H25|) ). This is shown in Fig.|21; 
and d and reveals that for the parameter sets studied so far, the noise intensities are reasonably small such that the 
ETC formula gives an approximation almost as good as the extended expression by R&D. One exception to this is 
shown in Fig. O;: at small correlation times where the noise is effectively white (te — 0.1), the ETC formula fails 
since the noise variances become large. For — 0.01 the disagreement is even worse (not shown). In this range, the 
extended expression captures the density better, in particular its non-gaussian features (e.g. the asymmetry in the 
density). 

Since the agreement of the extended expression to numerical simulations was so far very good, one could argue that 
it represents the exact solution to the problem and the small differences are merely due to numerical inaccuracy. 
We will check whether the extended expression is the exact solution in two ways. Firstly, we know how the density 
behaves if both multiplicative noises are very slow (/3re,/3ri ^1), namely, according to cq. Ht)l|l . We possess thus an 
additional control of whether the extended solution eq. (|15|l is exact by comparing not only to numerical simulation 
results but also to the static-noise theory. Secondly, we have derived an exact integral expression eq. H70|l for the 
stationary mean value; so we can compare the stationary mean value according to the extended expression by R&D 
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Figure 3: Probability density of membrane voltage for different parameter sets, the extended expression eq. H15|l (a and b) and 
the effective-time constant approximation eq. 12511 (c and d) are compared to results of numerical simulations; simulation data 
and parameters as in Fig. ^ (a and c) and Fig. |5| (b and d) . 
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Figure 4: Probability density of membrane voltage for long correlation times; comparison of static-noise theory (eq. (1611 . 
solid lines) and extended expression by R&D (eq. (1151 . dashed lines) to numerical simulations (symbols). Panel a: Probability 
density of the shifted voltage variable (in arbitrary units) with Qe — Qi — S, [3 = l,Te — n — 20, Ve — 1.5, Vi = —0.50; for 
these parameters, the mean value is infinite; in the simulation we therefore had to implement reflecting boundaries, which will 
(if sufficiently distant) affect the density only in its tails but not in the range shown in the figure. Panel b: density for the 
original voltage variable with ql = 0.0452mS/cm^ , a = 34636^im^, Cm = l^iF/cm^,£;L = -80mV,J5e = OmV,^^ = -75mV,(Te = 
0.012/iS, ai = 0.045/iS, g^o = 0.121/iS, <?« ~ 0.0574/iS, Te = 7.5ms, n — 30ms; for these parameters the mean value is finite. 
Inset: Same data but on a logarithmic scale. 



(given in eq. lO) to the exact expression and to numerical simulations. 

To check the extended expression against the static-noise theory we have to choose parameter values for which /Jre 
and ^Ti are much larger than one; at the same time the noise variances should be sufficiently large. We compare 
both theories eq. (|15|l and eq. (|61ll once for the system eq. ()19|) . eq. (|20|l with simplified parameters at strong noise 
{Qe — Qi = 1) and large correlation times (/3Te ^ = 20) (Fig. 2t) a-nd once for the original system (Fig.^). For the 
latter, increases in Pr^^^i can be achieved by cither increasing gi^, g^Q, gio or by increasing the synaptic correlation times 
Te^i- We do both and increase geo to the ten-fold of the standard value by R&D (i.e. geo = 0. 0121^8 geo = 0.121/xS) 
and also multiply the standard values of the correlation times by roughly three (i.e. Tg = 2.728ms, = 10.45ms — > 
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Te = 7.5nis, Ti = 30ms); additionally, we also choose a larger standard deviation for the inhibitory conductance than 
in R&D's standard parameter set {ai = 0.0264/iS (li ~ 0.045/iS). For these parameters we have /3re « 4.2 and 
(3Ti « 16.8, so we may expect a reasonable agreement between static-noise theory and the true probability density of 
the voltage obtained by simulation. 

Indeed, for both parameter sets, the static-noise theory works reasonably well. For the simulation of the original 
system (Fig. 0Jd) , we also checked that the agreement is significantly enhanced (agreement within line width) by using 
larger correlation times (e.g. ~ 20ms, — 100ms) as it can be expected. Compared to the static-noise theory, 
the extended expression by R&D shows stronger although not large deviations. There are differences in the location 
and height of the maximum of the densities for both parameter sets; prominent is also the difference between the tails 
of the densities (Fig. QJ) inset). Hence, there are parameters that are not completely outside the physiological range, 
for which the extended expression does not yield an exact but only an approximate description and for which the 
static-noise theory works better than the extended expression by R&D. This is in particular the case for strong and 
long-correlated noise. 



7.3 Mean value of the membrane voltage 

The second way to check the expressions by R&D was to compare their mean values to the exact expression for the 
stationary mean eq. 1)7011 . We do this for the transformed system eq. (I19|l . eq. (|20|) with dimensionless parameters. 
In Fig. [SI the stationary mean value is shown as a function of the correlation time Tg of the excitatory conductance. 
In the two different panels we keep the noise intensities Qg and Qi fixed; the correlation time of inhibition is small 
(panel a) or medium (panel b) compared to the intrinsic time scale {1/(3 = 1). We choose noise intensities Qi — 0.3 
and Qe = 0.2 so that the mean value is finite because eq. H67|) is satisfied. In Fig.[S^ the disagreement between the 
extended theory by R&D (dash-dotted line) and the exact solution (thick solid line) is apparent for medium values of 
the correlation time. To verify this additionally, we also compare to numerical simulation results. The latter agree 
with our exact theory for the mean value within the numerical error of the simulation. We also plot two limits that 
may help to understand why the new theory by R&D works in this special case at very small and very large values 
of te- At small values, both noises are effectively white and we have already discussed that in this case the extended 
expression for the probability density eq. H15|l approaches the correct white-noise limit. Hence, also the moment should 
be correctly reproduced in this limit. On the other hand, going to large correlation time at fixed noise intensity Qe 
means, that the effect of the colored noise yeit) on the dynamics vanishes. Hence, in this limit we obtain the mean 
value of a system that is driven only by one white noise (i.e. yi{t)). Also this limit is correctly described by R&D's 
new theory since the effective noise intensity Q'^ ~ 2Qe/[l + (3Te\ vanishes for Tg — > oo if Qe is fixed. However, for 
medium values of Tg, the new theory predicts a larger mean value than the true value. The mean value eq. H72|l of 
the original solution eq. (|12|l (dotted lines in Fig.jS]) leads to a mean value of the voltage that does not depend on the 
correlation time Te at all. 

If the second correlation time tj is of the order of the effective membrane time constant 1//3 (Fig.lSJj), the deviations 
between the mean value of the extended expression and the exact solution is smaller but extends over all values of 
Te- In this case the new solution does not approach the correct one in neither of the limit cases Tg — > or Tg ^ oo. 
The overall deviations between the mean according to the extended expression is small. Also for both panels, the 
differences in the mean are small compared to the standard deviations of the voltage. Thus, the expression eq. (|73|l 
corresponding to the extended solution can be regarded as a good approximation for the mean value. 
Finally, we illustrate the convergence or divergence of the mean if the condition eq. (I67II is obeyed or violated , 



respectively. First, we choose the original system and the standard set of parameters bv iRAidolph and Destexhf 



and simulate a large number of trajectories in parallel. All of these are started at the same value {V = 0) and each 
with independent noise sources, the initial values of which are drawn from the stationary Gaussian densities. In an 
experiment, this corresponds exactly to fixing the voltage of the neuron via voltage clamp and then to let the voltage 
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Figure 5: Stationary mean value of the shifted voltage (in arbitrary units) vs correlation time (in arbitrary units) of the 
excitatory conductance. Noise intensities Qe ~ 0.2, Qi — 0.3, Qi = and fH = 1 are fixed in all panels. The correlation time of 
the inhibitory conductance is Ti = 10~^ (a) and Ti — 1 (b). Shown are the exact analytical result eq. 17011 (solid line), the mean 
value according to the original solution eq. 17211 (dotted line), and the mean value according to the extended solution eq. 17311 
(dash-dotted line). In panel a, we also compare to the mean value of the white-noise solution for Qe — 0.2, Qi = 0.3 (thin solid 
line) and for Qe = 0,Qi — 0.3 (dashed line) as well as to numerical simulation results (symbols). 




t in seconds 



Figure 6: Time dependent mean value of the original voltage variable (in Volts) as a function of time (in seconds) for the 
initial value V{t = 0) = OV and different values of the inhibitory conductance standard deviation (t^; numerical simulations of 
eq. H19^ and eq. 120^ (circles) and theory according to eq. I|66|l (solid lines). For all curves geo = 0.0121 jj.S, gio = 0.0573 nS, 
(Te = 0.012 /iS, Te = 2.728 ms, Ti = 10.49 ms, a — 34636/im^, and Cm ~ IfiF/cm^. For the dashed line (theory) and the grey 
squares (simulations) we cho ose at = 0.0264 /iS, hence in this case, parameters correspond to the standard parameter set by 
iRiidolnh and Destexhel ( |2003l ) . For the solid line (theory) and the black circles we used ai = 0.066 /iS corresponding to the 250% 
of the standard value by R&D. While at the standard parameter set, the mean value saturates at a finite level, in the second 
case the mean diverges and goes beyond lOOmV within 31ms. Simulations were carried out for 10^ voltage trajectories using 
an adaptive time step (always smaller than 0.01 ms) that properly took into account those trajectories that diverge strongest. 
The large number of trajectories was required in order to get a reliable estimate of the time-dependent mean value in the case 
of strong noise {ai — 0.066 fiS) where voltage fluctuations are quite large. 



freely evolve under the influence of synaptic input (that has not been affected by the voltage clamp). We compare the 
time-dependent average of all trajectories to our theory eq. ]b<j\i (in terms of the original variable and parameters). For 
R&D's standard parameters the mean value reaches after a relaxation of roughly 20ms a finite value (V« — 65mV). The 
time course of the mean value is well reproduced by our theory as it should be. Increasing one of the noise standard 
deviations to a 2.5-fold of its standard value (ci ~ 0.0264 /iS 0.066 /iS), which is still in the range inspected by 
R&D, results in a diverging mean^. Again the theory (solid line) is confirmed by the simulation results (black circles). 
Starting from zero voltage, the voltage goes beyond lOOmV within 31ms. In contrast to this, the mean value of the 
extended formula is finite (the condition eq. (|47|l is obeyed) and the mean value formula for this density eq. H73(l yields 
a stationary mean voltage of —66 mV. Thus, in the general colored-noise case, the extended formula cannot be used 
to decide whether the moments of the membrane voltage will be finite or not. 

^ These parameter values were not considered by R&D to be in the physiological range. We cannot, however, exclude that other 
parameter variations (e.g. decreasing the leak conductance or increasing the synaptic correlation times) will not lead to a diverging mean 
for parameters in the physiological range. 
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We note that the divergence of the mean is due to a small number of strongly deviating voltage trajectories in the 
ensemble over which we average. This implies that the divergence will not be seen in a typical trajectory and that a 
large ensemble of realizations and a careful simulation of the rare strong deviations (adaptive time step) is required 
to confirm the diverging mean predicted by the theory. Thus, although the linear model with multiplicative Gaussian 
noise is thought to be a simple system compared to nonlinear spike generators with Poissonian input noise, its careful 
numerical simulation may be much harder than that of the latter type of model. 

8 Conclusions 

We have demonstrated that the formula for the probability density of the membrane voltage driven by multiplicative 
and/or additive (conductance and/or current noise) proposed by R&D in their original paper is wrong in general. 
In particular, it fails in all tractable limit cases (white noise driving, colored additive noise, and static multiplicative 
noise). Their extended expression, however, seems to provide a good approximation to the probability density of the 
system for a large range of parameters. 

In the appendix we show where errors have been made in the derivation of the Fokker-Planck equation on which both 
the original and extended solutions are based. Although there are serious flaws in the derivation, we have seen that 
the new formula (obtained by an ad-hoc introduction of effective correlation times in the original solution) gives a 
very good reasonable approximation to the probability density for weak noise. What could be the reason for this good 
agreement? 

The best though still phenomenological reasoning for the solution eq. (|15|l goes as follows. Firstly, an approximation 
to the probability density should work in the solvable white-noise limit 

lim Pa-ppr{v,Qe,Qi,Te,n) = p^ri{v,Qe,Qi) (75) 

Secondly, we know that at weak multiplicative noise of arbitrary correlation time the effective-time constant approxi- 
mation will be approached 

Pappr{v,Qe,Qi,Te,Ti) = pETc{v,Qe,Qi,Te,Ti), (Qg , Small) (76) 

The latter density given in eq. (|25|l can be expressed by the white-noise density with rescaled noise intensities (note 
that the variance in the ETC approximation given in eq. H26(l has this property); furthermore, it is close to the density 
for white multiplicative noise if the noise is weak 

PETC{V, Qe/(1 + /3Te), Q,/(l + /3r,), 0, 0), 
p(^;,Qe/(l+/3Te),Q,/(l+/3T,),0,0) 

Pv,n{v, Qe/{1 + /3re), Q,/(l + pT,)) (77) 

Hence, using this equation together with eq. (|76|l . one arrives at 

Pappriv,Qe,Qi,Te,Ti) « /0.uj„(w, (9e/(l + /^Tg), (3,;/(l +/3ri)) (78) 

This approximation which also obeys eq. H75|) is the extended expression by R&D. It is expected to function in the 
white-noise and the weak-noise limits and can be regarded as an interpolation formula between these limits. We 
have seen that for stronger noise and large correlation times (i.e. in a parameter regime where neither of the above 
assumptions of weak or uncorrelated noise hold true) this density and its mean value disagree with numerical simulation 
results as well as with our static-noise theory. Regarding the parameter sets for which we checked the extended solution 
for the probability density, it is remarkable that the differences to numerical simulations were not stronger. 

Two issues remain. Firstly, we have shown that the linear model with Gaussian conductance fluctuations can show 
a diverging mean value. Certainly, for higher moments, as for instance, the variance, the restrictions on parameters 



PETc{v,Qe,Qi,Te,Ti) = 

(Qa-Qi small) 
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will be even more severe than that for the mean value (this can be concluded from the tractable limit cases we have 
considered). As demonstrated in case of the stationary mean value, the parameter regime for such a divergence cannot 
be determined using the different solutions proposed by R&D. 

Of course, a real neuron can be driven by a strong synaptic input without showing a diverging mean voltage — the 
divergence of moments found above is just due to the limitations of the model. One such limitation is the diffusion 
approximation on which the model is based. Applying this approximation, the synaptically filtered spike train inputs 
have been replaced by Ornstein-Uhlenbeck processes. In the original model with spike train input, it is well known that 
the voltage cannot go below the lo west reversal potential Ej o r above the excitatory reversal potential if no current 
(additive) noise is present (see e.g. iLanskv and Lanskal (|1987j) for the case of unfiltered Poissonian input). In this case, 
we do not expect a power law behavior of the probability density at large values of the voltage. Another limitation of 
the model considered by R&D is that no nonlinear spike generating mechanism has been included. In particular, the 
mechanism responsible for the voltage reset after an action potential would prevent any power law at strong positive 
voltage. Thus, we see that at strong synaptic input the shot-noise character of the input and nonlincarities in the 
dynamics cannot be neglected anymore and even determine whether the mean of the voltage is finite or not. 
The second issue concerns the consequences of the diffusion approximation for the validity of the achieved results. 
Even if we assume a weak noise such that all the lower moments like mean and variance will be finite, is there 
any effect of the shot-noise character of the syna ptic input that is not taken into account properly by the diffusion 
approximation? iRichardson and Gerstnen l|2005(l have recently addressed this issue and shown that the shot-noise 
character will affect the statistics of the voltage and that its contribution is comparable to that resulting from the 
multiplicativity of the no i se. T hus, for a consistent treatment one should either include both features (as done by 
Richardson and Gerstner J^QflS ) in the limit of wea k synaptic noise) or none (corresponding to the effective-time-scale 



approximation, cf. IRichardson and Gerstner 



Summarizing, we believe that the use of the extended expression by R&D is restricted to parameters obeying 

|3:^Qe + Q^■ 



(79) 



This restriction is consistent with (1) the diffusion approximation on which the model is based; (2) a qualitative 
justification of the extended expression by R&D as given above; (3) the finiteness of the stationary mean and variance. 
For parameters which do not obey the condition eq. (|79|l . one should take into account the shot-noise statistics of the 
synaptic drive. Recent perturbation results were given bv IRichardson and Gerstneil 1120051) assuming weak noise; we 
note that the small parameter in this theory is (Qe + Qi)/ (3 and therefore exactly equal to the small parameter in 
eq. 

The most promising result in our paper seems to be the exact solution for the time-dependent mean value, a statistical 
measure that can be easily determined in an experiment and might tell us a lot about the synaptic dynamics and 
its parameters. The only weakness of this formula is that it is still based on the diffusion approximation, i.e. on the 
assumption of Gaussian conductance noise. One may, however, overcome this limitation by repeating the calculation 
for synaptically filtered shot-noise. 



9 Acknowledgments 

This research was supported by NSERC Canada and a Premiers Research Excellence Award (PREA) from the Gov- 
ernment of Ontario. We also acknowledge an anonymous reviewer for bringing the unpublished Note by R&D to our 
attention. 



A Errors made in the derivation of the Fokker-Planck equation 

Let us first note that although R&D use a so-called Ito rule, there is no difference between the Ito and Stratonovich 
interpretations of the colored- noise-driven membrane dynamics. Since the noise processes possess a finite correlation 
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time, the Ito-Stratonovich dilemma occurring in systems driven by white multipUcative noise is not an issue here. 
To comprehend the errors in the analytical derivation of the Fokker-Planck equation in R&D, it suffices to consider 
the case of only additive OU noise. For clarity we will use our own notation: the OUP is denoted by yi{t) and we 
set ft,/ = 1 (the latter function is used in R&D for generality). R&D give a formula for the differential of an arbitrary 
function F{v{t)) in eq. (B.9) 

dF{v{t)) = d^F{v{t))dv + ^diF{v{t)){dvf (80) 
R&D use the membrane equation in its differential form, which for vanishing multiplicative noises reads 

dv = f{v)dt + dwi (81) 

where the drift term is f{v) — —j3v and wi is the integrated OU process ?//, i.e. 

t 

wi= I ds vi{s). (82) 







Inserting eq. (|81|l into eq. H8()|l. we obtain 



dF{v{t)) = d,F{v{t))f{v{t))dt + d^F{v{t))dwi + ]^dlF{v{t)){dwif (83) 

This should correspond to eq. (B.IO) in R&D for the case of zero multiplicative noise. However, our formula differs 
from eq. (B.IO) in one important respect: R&D have replaced {dwjY by 2aj{t)dt using their Ito rule^ eq. (A. 13a). 
Dividing by dt, averaging, and using the fact that for finite r/ dwi{t)/dt = yi{t), we arrive at 

^^^^^ = {d^Fivmivm + {d,,F{v{t))yj{t)) + ].(dlF{v{t))'^^^). (84) 

This should correspond to eq. (B.12) in R&D (again for the case of vanishing multiplicative noise) but is not equivalent 
to the latter equation for two reasons. Firstly, R&D set the second term on the r.h.s. to zero reasoning that the mean 
value {yi{t)) is zero (they also use an argument about /i{e.ij}, which is irrelevant in the additive noise case considered 
here). Evidently, if yi{t) is a colored noise it will be correlated to its values in the past y{t') with t' < t. The voltage 
v(t) and any nontrivial function F{v{t)) is a functional of and therefore correlated to yi{t') with t' < t. Consequently, 
there is also a correlation between yi{t) and F{v{t)), and thus 

{d,Fivit))yj{t)) ^ (d^FivmiViit)) = (85) 

Hence, setting the second term (that actually describes the effect of the noise on the system) to zero is wrong^. This 
also applies for the respective terms due to the multiplicative noise. 

Secondly, the last term on the r.h.s. of eq. (|84|l was treated as a finite term in the limit t oo. According to R&D's 
eq. (A. 13a) (for i — j), eq. (3.2), and eq. (3.3), hm {{dwi)"^) = lim 2ai{t)dt — (rjridt and, thus {{dwj))/dt — > ct|t/ 

t — ^oo t — ^oo 

a.s t ^ oo. However, the averaged variance of dwj = yi{t)dt is {(dwi)'^) — {yi{t)'^){dt)'^ — aj{dt)^ and, therefore, the 
last term in eq. H84I) is of first order in dt (since {dwi)'^/dt = yi{t)^dt ^ dt) and vanishes. We note that the limit 
in eq. (3.3) is not correctly carried out — even if we follow R&D in using their relations (A. 13a) together with the 
correct relation (A. 10a), we obtain that for finite t/, the mean squared increment {{dwi)'^) is zero in linear order in 
dt for all times t which is in contradiction to eq. (3.3) in R&D. 

We now show that keeping the proper terms in eq. (|84|l does not lead to a useful equation for the solution of the 
original problem. After applying what was explained above, eq. (|84ll reads correctly 

d(F{vm 



{d,F{v{t))f{v{t))) + {d,F{v{t))yj{t)). (86) 



®Note that R&D use o/(t) for two diflferent expressions, namely, according to eq. (B.8) for [t/(1 — exp(— t/r/)) — t] + w^{t) / (2tj) but 
also according to eq. (3.2) in R&D for the average of this stochastic quantity. 

''For those readers, still unconvinced of eq. 1851 a simple example: Let F{v{t)) = v^{t)/2. Then {d^F{v{t))yj {t)) = {v(t)yj(t)). In the 
stationary state this average can be calculated as J J dvdyi vyjPo{v, yj) using the density eq. 1531 . This yields {v{t)yj (t)) = Qi /[I + /3tj] 
which is finite for all finite values of the noise intensity Qj and correlation time r/ . Note that this line of reasoning is only valid for truly 
colored noise (t/ > 0); the white-noise case has to be treated separately. 
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Because of the correlation between v{t) and y/(t), we have to use the fuU two-dimensional probability density to 
express the averages 



which is not a closed equation for p(v,t), nor is it a Fokker-Planck equation. The above equation with f{v) = —f3v 
can be also obtained by integrating the two-dimensional Fokker-Planck equation eq. H52(l over yi . 
In conclusion, by neglecting a finite term and assuming a vanishing term to be finite, R&D have effectively replaced 
one term by the other, i.e. the colored-noise drift term is replaced by a white-noise diffusion term, the latter with 
a prefactor that corresponds to only half of the noise intensity. This amounts to a white-noise approximation of the 
colored conductance noise, although with a noise-intensity that is not correct in the white-noise limit of the problem. 
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